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The invention provides a system for en- 
try and modification of multimedia elements for 
communication and presentation. Abbreviations, 
each comprising a sequence of one or more key- 
strokes or mouse actions are associated with indi- 
vidual multimedia elements, so that a human op- 
erator can enter those multimedia elements using 
a keyboard or mouse. Each multimedia element 
has properties, which can be modified once the 
multimedia element has been entered. The set 
of individual multimedia elements is collected 
into an ensemble, which can itself have proper- 
ties that can be modified. One such property of 
the ensemble is a •theme", which applies to a 
plurality of multimedia elements in the ensem- 
ble and presents a Variant of each multimedia 
element consistent with the theme. The multi- 
media editor is included With a communication 
system for sending and receiving electronic chat 
and electronic mail messages in real time, and 
for presenting web documents in a compressed 
form. When a sender enters an abbreviation, 
an associated multimedia element is transmitted 
as an electronic chat message or constructed for 
transmission as an electronic mail message; the 
choice of associated multimedia element can be 
responsive to a receiver's capability, and can be 
selected at the receiver dynamically in response 
to user actions. The sender can also transmit a theme; multimedia objects are presented to the recipient using the sender's theme, or can 
be overriden to use a different theme. If the multimedia objects associated with the abbreviations are available at the recipient or at a 
common server, electronic chat messages, electronic mail messages, and web documents can be compressed and transmitted using only the 
abbreviations. 
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Multimedia Communication and Presentation 
5 Background of the Invention 

L Field of the Invention 

This invention relates to multimedia communication and presentation. 

10 

2. Related Art 

In computer systems for communicating and presenting data, it is de- 
sirable to communicate and present data in a multiplicity of media. Such communi- 
15 cation is sometimes called "multimedia communication/' For example, these media 
can include text, sound, pictures, animation, and combinations thereof. One advan- 
tage of multimedia communication is that it can more vividly communicate mes- 
sages to recipients. 

20 One problem in the known art is that multimedia elements comprise 

significant amounts of data, and are therefore difficult to construct from "scratch" 
(that is, from basic elements) and difficult to enter into a computer system. This 
problem is acute for pictures and similar graphical elements, which must generally 
be "captured" using video equipment. For example, it would be desirable for users 

25 to be able to enter picture data into messages for sending, such as when using elec- 
tronic chat or electronic mail systems. However, known electronic chat systems do 
not provide this capability, and known electronic mail systems provide only tech- 
niques by which pictures that have already been captured using other equipment can 
be attached to electronic mail messages and transmitted. 

30 

Accordingly, it would be advantageous to provide a system in which 
multimedia elements can easily be entered and modified, especially in real time. 

1 
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This advantage is achieved in a sy sl e )n in which mu „ imcdia e ^ . 

with KeystroKe or mouse abbreviatjons M ^ b£ J- « assoca.ed 

otouse, and in which propcrties of ^ ^ muUjme "e^n " 

semble of multimedia elements can be edhed ,„ alter , h e presentation of 'di^ " 
= timedia elements. Presentation of those mul- 

Summarv <if the Invpnli™, 

The invention provides a system for enuv anri jt . 

- -ia elements for communication and co 

a seonence of one or more Keynes or mouse actions .S^Z 
Hower ) are associated with individual multimedia element (such as a . , 
HOW., so .a, a human operator can enter those mu.timedia 
board or mouse. Each multimedia element has properties (such as ,1 
• or detai,,, which can be modified once the multildi «Z „ h ^ 
(such as altering me fiower from a re,a„ve, y smafier P S*Z ^2 T 
Picnue). TTte set of individua, multimedia e.emems is col.ee, d ^ 
which can itselfhave properties ma, can be modified. " Z I"' 
scm le is a whi ch appfies ,„ a plurality of multimedia ZZ ^ 

- le and presents a varian, of each multimedia element consistent 1 l^Z 
(such as representing the flower as a cactus in a "Western" ,h 
"Romantic" theme). lh =n«. or as a rose in a 

In a preferred embodiment, the multimedia editor is indued 
communication system for sending and receiving electronic chaTId e r o ni I ' 
messages in real time, and for presenting web documents in ^ Z 

Each multimedia element can include text, sound pictures anim , 
fragments (such as a ,ava appl, a pointer to a database t^ a^ 
or a com .nation or compilation thereof. When a sender enters an bbre a loTan 
assocated multimedia element is Emitted a, an electronic chat messau or c 
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—a element can be response ,o a receiver, capability, and can be 
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at the receiver dynamically in response to user actions (such as time taken to look at 
the multimedia element). The sender can also transmit a theme; multimedia objects 
are presented to the recipient using the sender's theme, or can be overridden to use a 
different theme. If the multimedia objects associated with the abbreviations are - 
available at the recipient or at a common server, electronic chat messages, electronic 
mail messages, and web documents can be compressed and transmitted using only 
the abbreviations. 

Brief Description of the Drawings 

Figure 1 shows a block diagram of a system for multimedia communi- 
cation and presentation. 

Figure 2 shows a flow diagram of a method for multimedia communi- 
15 cation and presentation. 

Detailed Descri ption of the Preferred Embodiment 

In the following description, a preferred embodiment of the invention 
20 is described with regard to preferred process steps and data structures. Those skilled 
in the an would recognize after perusal of this application that embodiments of the 
invention can be implemented using general purpose processors or special purpose 
processors adapted to particular process steps and data structures described herein, 
and that implementation of the process steps and data structures described herein 
25 would not require undue experimentation or further invention. 

System Elements 

Figure 1 shows a block diagram of a system for multimedia communi- 
30 cation and presentation. 
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A system 100 includes a plurality of client stations 110, each capable 
of executing client software 1 1 1 such as an electronic chat client or an electronic 
mail client, and a server station 120, capable of executing server software 121 such 
as an electronic chat server or an electronic mail server. The client stations 1 10 and 
the server station 120 are coupled using a communication network 130. 

In a preferred embodiment, the client stations 1 10 and the server sta- 
tion 120 communicate using a known communication protocol, such as POP or 
SMTP (simple mail transfer protocol). The client stations 1 10 and the server station 
120 use the known communication protocol for transmitting electronic mail mes- 
sages, HTTP (hypertext transfer protocol) for transmitting web documents, and other 
known communication protocols for transmitting electronic chat messages. 

As used herein, the terms "client" and "server" refer to a relationship 
between the client station and the server station, not necessarily to particular physi- 
cal devices. As used herein, one "client station" or one "server station" can com- 
prise any of the following: (a) a single physical device capable of executing software 
which bears a client or server relationship to another station; (b) a portion of a 
physical device, such as a software process or set of software processes capable of 
executing on one hardware device, which portion of the physical device bears a cli- 
ent or server relationship to another station; or (c) a plurality of physical devices, or 
portions thereof, capable of cooperating to form a logical entity which bears a client 
or server relationship to another station. The phrases "client station" and "server 
station" refer to such logical entities and not necessarily to particular individual 
physical devices. 

Each client station 1 1 0 includes a processor, program and data mem- 
ory, and mass storage (such as a magnetic or optical disk drive). Each client station 
1 10 includes a set of input peripherals 1 12, including a character input element (such 
as a keyboard) and a graphic input element (a pointing device such as a mouse, pen. 
or trackball), and a set of output peripherals 1 13, including a visual display element 
(such as a monitor or printer) and an audio presentation element (such as a set of 
speakers). 

4 
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The mass storage includes a database 1 14, including a set of abbrevia- 
tions 115, a set of multimedia objects 1 16. and a set of associations 1 17 there be- 



tween 



Each abbreviation 115 includes a selected sequence of keystrokes 
(such as typed characters) and/or mouse actions (such as left-button clicks, right- 
button clicks, and double-clicks). In a preferred embodiment, the abbreviations 1 1 5 
comprise mnemonic names, such as typed words like "flower" to represent a picture 
of a flower, "foghorn" to represent a sound clip of a foghorn, and the like, but an op- 
erator at the client station 110 can also define new abbreviations 115, such as the 
name of a favorite dog to represent a picture of that dog, even though that name can 
comprise an arbitrary sequence of characters. 

Each multimedia object 1 16 includes a data element for use with mul- 
timedia presentation, such as a text element, an audio element (such as a sound clip 
in AU or WAV form), a graphical element, a picture element (such as a picture in 
GIF or JPEG form), or an animation or video element (such as a movie clip in AVI 
or MPEG form). The multimedia objects 1 16 can also include data elements such as 
databases, program fragments (such as Java applets or ActiveX hooks, CGI scripts, 
or a qualified URL), or special document formats (such as a document in Adobe 
PDF format). 

Each association 1 17 includes a link between an abbreviation 1 15 and 
at least one multimedia object 1 16, so that the client station 1 10 can detect the ab- 
breviation 1 15 and locate the multimedia object 1 16 in response thereto. 

When an operator of the client station 110 enters sequences of key- 
strokes and/or mouse actions, the client station 1 10 examines the database 1 14 and 
determines when one of the abbreviations 115 is entered. When the client station 
1 10 detects a particular abbreviation 115, the client station 1 10 notes the particular 

6 
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association 117 coupled to that particular abbreviation 115. and determines the (at 
least one) particular multimedia object 1 1 6 associated with that particular abbrevia- 
tion 115. The client station 110 thereby replaces that particular abbreviation 115 
with its associated multimedia object 116. 

In the case that there is more than one multimedia object 1 16 associ- 
ated with that particular abbreviation 1 1 5, the client station 1 1 0 can select one of 
those associated multimedia objects 1 16 in one of several ways: 

o The client station 110 can select one of those associated multimedia objects 
1 16 at random. 

o The client station 110 can select one of those associated multimedia objects 
1 1 6 on a round-robin basis. 

o The client station 1 10 can present two or more of those associated multimedia 
objects 1 16 to the operator and ask the operator to select one. 

After replacing the abbreviation 115 with its associated multimedia 
object 1 16 in the sequence, the client station 1 10 transmits an altered multimedia se- 
quence (that is, with the replacement having been made) to the server station 120, 
such as for transmission to a destination client station 1 10 as an electronic chat mes- 
sage or an electronic mail message. The server station 120 transmits the multimedia 
sequence to the destination client station 110 using an electronic chat protocol or an 
electronic mail protocol. The destination client station 1 10 receives the multimedia 
sequence and presents the multimedia elements to an operator at the destination cli- 
ent station 110. 

In a preferred embodiment, the client station 110 can replace a par- 
ticular abbreviation 115 with a multimedia object 116 comprising a particular pro- 
gram fragment in one of at least two ways: 

7 
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o The client station 1 10 can insen that program fragment into the multimedia 

sequence, so that the destination client station 110 receives the program 

fragment for execution, 
o The client station 1 1 0 can execute that program fragment directly, so that the 

destination client station 110 receives the multimedia sequence after opera- 

tion thereupon by the particular program fragment. 

In a preferred embodiment, the multimedia objects 1 16 can be created 
using multimedia capture and editing software, such as for scanning pictures and 
editing those pictures, recording sound clips and editing those sound clips, or for 
creating and/or editing animation sequences. 

In a preferred embodiment, the multimedia objects- 1 16 can be located 
at the client station 1 10, at the server station 120, or at another device coupled to the 
network 130 and accessible by either the client station 1 10 or the server station 120. 
If located remotely from the client station 110, the multimedia objects 116 can be 
cached at the client station 110, in the database 114 or otherwise, for use as de- 
scribed herein. 

The abbreviations 1 15 and the associations 1 17 can be created using a 
text editor (or similar software for entering and editing information comprising key- 
strokes), designating the particular sequences of keystrokes and/or mouse actions 
which comprise the abbreviations 115 and names of those multimedia objects 116 
pointed to by their associations 1 1 7. 

The abbreviations 1 15 and the associations 1 17 can also be located at 
the client station 1 10, at the server station 120, or at another device coupled to the 
network 130 and accessible by either the client station 1 10 or the server station 120. 
If located remotely from the client station 110, the multimedia objects 116 can be 
cached at the client station 110, in the database 114 or otherwise, for use as de- 
scribed herein. 
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In a preferred embodiment, at least some abbreviations 115 are associ- 
ated with a plurality of multimedia objects 1 16 arranged in a sequence or hierarchy. 
The hierarchy of multimedia objects 1 16 includes a set of variants of a core multi- 
media object 1 16 (not necessarily a particular single multimedia object 1 16) ? differ- 
ing with regard to a set of parameters such as size, complexity, or detail. 

For example, the typed word "flower" can comprise an abbreviation 

1 15 and can be associated with a hierarchy of multimedia objects 116 representing 
flowers, including a stylized graphic of a flower, a relatively small photographic 
picture of a flower, a relatively large photographic picture of a flower, an animation 
of a flower, and an applet for emulating a flower (including being responsive to local 
weather reports). 

When the operator enters the abbreviation 115, the client station 110 
can offer the operator an opportunity to select among the hierarchy of multimedia 
objects 1 16 representing flowers. The client station 1 10 can also offer the operator 
an opportunity to alter the selection, either using a separate set of editing commands 
for the multimedia object 116, or using one or more abbreviations 115 associated 
with one or more of those editing commands. 

For example, when the operator enters a particular multimedia object 

1 16 using the typed word "flower", the client station 110 retains information about 
the properties of that multimedia object 116, including properties in the hierarchy of 
those multimedia objects 116 associated with that particular abbreviation 1 15. The 
client station 1 10 can alter the particular multimedia object 1 16 so as to select a dif- 
ferent one of those multimedia objects 1 16 associated with that particular abbrevia- 
tion 1 15. 

Similarly, the client station 110 can replace the abbreviation 115 with 
the entire hierarchy of those multimedia objects 116, including a description of its 
set of properties, so that the entire hierarchy of those multimedia objects 116 is 

9 
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transmitted to the destination client station 110. The destination client station 110 
can select one of those multimedia objects 1 16 associated with that particular abbre- 
viation 1 15 for presentation, and can allow the operator of the destination client sta- 
tion 1 10 to alter the particular multimedia object 1 16 so as to select a different one 
of those multimedia objects 1 16 associated with that particular abbreviation 1 15. 

In a preferred embodiment, the destination client station 1 10 can select 
one of those multimedia objects 1 16 associated with that particular abbreviation 1 15 
in the following ways: 

o The destination client station 1 1 0 can ask the operator of the destination cli- 
ent station 1 10 to choose one of those multimedia objects 1 16. 

o The destination client station 1 1 0 can select one of those multimedia objects 
1 16 responsive to capabilities of the client station 110. 

The destination client station 1 1 0 can select one of those multimedia objects 
1 16 responsive to preferences known for the operator. 



o The destination client station 1 1 0 can select one of those multimedia objects 
1 16 responsive to actions by the operator, such as an amount of time the op- 
erator uses viewing that multimedia object 1 16. For example, the destination 
client station 1 10 can alter the selected multimedia object 1 16 to present more 
detail when the operator uses more time viewing that multimedia object 1 16. 

Ensemble of Multimedia Objects 

In any particular object, the set of individual multimedia objects 116 
used therein is collected into an ensemble, which can itself have properties that can 
be modified. One such property of the ensemble is a "theme," which applies to a 
plurality of multimedia elements in the ensemble and presents a variant of each mul- 
timedia element consistent with the theme. 
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tor example, in an ensemble of multimedia objects 116, those multi- 
media objects 1 16 representing flowers could each be represented as a picture of a 
cactus when the theme is a "Western"' theme, or could each be represented as a pic- 
ture of a rose when the theme is a "Romantic* 7 theme. Similarly, in that same en- 

5 semble, those multimedia objects 116 representing hats could each be represented as 
a picture of a cowboy hat when the theme is a "Western" theme, or could each be 
represented as a picture of a helmet when the theme is a "Military" theme. Example 
themes could include an "Ancient" theme, a "Gothic" theme, a "Military" theme, a 
"Modern" theme, an "MTV" theme, a "Romantic" theme, a "Western" theme, or 

10 other themes known in art or literature. 

Altering the theme for an ensemble would thus alter the presentation 
of each multimedia object 1 16 that is linked to the theme for that ensemble. The 
theme can also be associated with multimedia objects 116 that are not specifically 
15 entered using abbreviations 1 15, such as a background multimedia object 1 16 for the 
ensemble. 

When the operator enters a particular data object that might include 
one or more multimedia objects 116, the client station 1 10 can offer the operator an 
opportunity to select a theme for that object. The client station 1 10 can also offer the 
20 operator an opportunity to alter the selection, either using a separate set of editing 
commands for the multimedia object 116, or using one or more abbreviations 115 
associated with one or more of those editing commands. 

When the operator enters a particular abbreviation 115, the client sta- 
25 tion 1 10 can select among the hierarchy of multimedia objects 1 16 to find one asso- 
ciated with the theme for the ensemble. The client station 1 10 can also offer the op- 
erator an opportunity to alter the selection so as to make that multimedia object 1 1 6 
either more or less consistent with the theme, either using a separate set of editing 
commands for the multimedia object 116, or using one or more abbreviations 115 
30 associated with one or more of those editing commands. 
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For example, when the operator enters a particular data object, such as 
an electronic chat message or an electronic mail message, the client station 110 re- 
tains information about the properties of that data object, including its theme. For 
each multimedia object 1 16 in the data object, the client station 110 retains informa- 
tion about whether that multimedia object 116 uses the global theme for the data 
object, or has a specific different theme. 

Similarly, if the client station 110 can replace the abbreviation 115 
with the entire hierarchy of those multimedia objects 1 16, the client station 110 can 
indicate which theme the abbreviation 1 1 5 is to be represented with. The destination 
client station 1 10 can select one theme for those multimedia objects 1 16 associated 
with that particular abbreviation 115 for presentation, and can allow the operator of 
the destination client station 1 10 to alter the theme, and so alter the presentation of 
that particular multimedia object 116. 

In a preferred embodiment, the destination client station 1 10 can select 
the theme for each multimedia object 1 16 in the following ways: 

o The destination client station 1 10 can use the theme indicated by the sending 
client station 1 10. 

o The destination client station can ask the operator of the destination client 
station 1 1 0 to choose a theme. 

o The destination client station 110 can select a theme responsive to known 
preferences of the operator of the destination client station 110. 

Compression of Multimedia Objects 

In an aspect of the invention, when the abbreviations 1 15, multimedia 
objects 1 16, and associations 1 17 are available both to the sending client station 1 10 
and to the destination client station 1 10, data objects including multimedia objects 

12 
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* • 

1 1 6 can be compressed when transmitting ihose data objects from the sending client 
station 1 10 to the destination client station 110. 

In this aspect of the invention, the sending client station 1 10 examines 
5 a data object in a message (such as an electronic mail message or a web document) 
to be transmitted from the sending client station 1 10 to the destination client station 
1 10. When the data object includes a particular multimedia object 116 for which 
there is an association 1 17 with a particular abbreviation 115, the sending client sta- 
tion 110 replaces that multimedia object 1 16 in the data object with its associated 
10 abbreviation 115. The data object is thereby compressed into a more compact form. 

The sending client station 110 transmits the message, including the 
compressed data object, to the server station 120, which transmits the message, in- 
cluding the compressed data object, to the receiving client station 1 10. The receiv- 
15 ing client station 110 examines the compressed data object in the message, replaces 
each abbreviation 115 with its associated multimedia object 116, and presents the 
message, including the original data object, to an operator. 

In alternative embodiments, the multimedia objects 1 16 can be avail- 
20 able at a remote device coupled to the network 130, and the receiving client station 
110 can cache those multimedia objects 1 16 or obtain them as needed. 

In alternative embodiments, the abbreviations 115 and the associations 

117 can be transmitted with the message and the compressed data object. 

25 

Behavior Associated with Abbreviations 

Each multimedia object 1 16 can include a program fragment, such as a 
Java applet, a CGI script for accessing a local database, or a URL for accessing a 
30 remote data object. More generally, each abbreviation 1 15 can be associated with a 
sequence of behavior, such as performed by executing a Java applet as the associated 
multimedia object 116. 

13 
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For example, an abbreviation such as the typed word "sales' 7 could be 
associated with a multimedia object 116 including a Java applet or CGI script for 
accessing a local database, retrieving a value for total sales, and inserting that value 
into the data object in which the abbreviation 1 15 is found. 

In a preferred embodiment, a library includes such abbreviations 1 15. 
multimedia objects 116 including program fragments, and associations 117; and that 
library is available at the client station 1 10 or at a remote device coupled to the net- 
work 130. 

Method of Operation 

Figure 2 shows a flow diagram of a method for multimedia communi- 
cation and presentation. 

A method 200 includes a set of flow points to be noted, and steps to be 
executed, cooperatively by the system 100, including the sending client station 1 10, 
the server station 120, and the destination client station 110. 

At a flow point 210, an operator at a particular client station 110 is 
ready to enter a data object intended to include multimedia objects 1 16 for commu- 
nication or presentation. The data object can comprise an electronic chat message, 
an electronic mail message, a file object, a web document, or another type of data 
object known in the disparate arts of computer science. 

For example, the data object can comprise an electronic chat message 
being composed at a keyboard in real time. 

At a step 221, the operator at the client station 1 10 enters a sequence 
of keystrokes and mouse actions, such as using a text editor or similar application 
program for entry of text objects. 

14 
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For example, the operator at the client station 1 10 can type a sequence 
of printable text characters. 

5 At a step 222, the client station 110 examines the sequence of key- 

strokes and mouse actions, and examines its database 1 14, so as to detect and locate 
any abbreviations 1 15 in the entered sequence of keystrokes and mouse actions. 

For example, a particular abbreviation 115 can comprise the typed 
word "flower". 

10 

If the client station 110 detects any abbreviations 115, it continues 
with the next step. Otherwise, it continues with the flow point 230. 

At a step 223, the client station 1 10 examines the properties of any as- 
15 sociated ensemble of multimedia objects 116, and determines whether any such 
properties affect presentation of any multimedia objects 116 associated with the de- 
tected abbreviations 115. In particular, the client station 110 determines if there is a 
theme associated with any such ensemble, and further determines if any such theme 
affects presentation of any multimedia objects 1 16 associated with the detected ab- 
20 breviations 115. 

For example, if the data object has an associated theme and the theme 
is a "Western" theme or a "Romantic" theme, the client station 1 10 determines that 
the theme would affect presentation of a multimedia object 116 associated with the 
25 abbreviation 1 15 the typed word "flower' (such as to select a picture of a cactus or a 
rose, respectively). 

At a step 224, the client station 110 examines the associations 1 17 in 
the database 114, and replaces the detected abbreviations 115 with associated mul- 
30 timedia objects 1 16. 

15 

SUBSTITUTE SHEET (RULE 26) 



WO 99/50744 • • PCT/US99/Q7257 

For example, the client station 110 could replace the typed word 
^flower ■ with a picture representing a flower. 

At a step 225, the client station 1 10 determines if the associated mul- 
5 timedia objects 116 have properties to be determined which affect presentation or 
which select among multiple associated multimedia objects 1 16 in a hierarchy. 

For example, the picture representing a flower can have a property 
"detail" which distinguishes among a stylized graphic of a flower, a relatively small 
10 photographic picture of a flower, a relatively large photographic picture of a flower, 
an animation of a flower, and an applet for emulating a flower. 

If the client station 1 10 detects any properties to be determined, it con- 
tinues with the next step. Otherwise, it continues with the flow point 230. 

15 

At a step 226, the client station 1 10 selects values for the properties of 
the multimedia objects 116. In a preferred embodiment, these values can be over- 
ridden by an operator at the client station 1 10 or at the destination client station 1 10. 

20 Similar to the steps 222 through 226, the sending client station 1 10 can 

detect multimedia objects 116 with associated abbreviations 115 and replace those 
multimedia objects 116 with their associated abbreviations 115 (and associated 
properties), so as to compress the data object. 

25 At a flow point 230, the data object is ready for transmission from the 

sending client station 1 10 to one or more destination client stations 1 10. 

At a step 241, the sending client station 1 10 transmits the data object 
to the server station 120 using the network 130 and a known transmission protocol. 

30 

For example, the server station 120 can comprise an electronic chat 
server and the known transmission protocol can comprise an electronic chat trans- 
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mission protocol. Similarly, the server station 120 can comprise an electronic mail 
server and the known transmission protocol can comprise ah electronic mail trans- 
mission protocol. 

At a step 242, the server station 120 transmits the data object to the 
destination client station 110 using the network 130 and the known transmission 
protocol. 

In alternative embodiments, the server station 120 may perform steps 
similar to the steps 222 through 226, so as to replace abbreviations 115 known to the 
server station 120 with associated multimedia objects 1 16, or to replace multimedia 
objects 1 16 known to the server station 120 with associated abbreviations 115 (and 
associated properties). 

In alternative embodiments, the sending client station 1 10 may trans- 
mit the data object directly to the destination client station 110 using the network 
130 and the known transmission protocol. 

At a step 243, the destination client station 110 receives the data object 
and its included multimedia objects 116. 

At a step 244, similar to the step 225, the destination client station 110 
determines if the associated multimedia objects 1 16 have properties to be determined 
which affect presentation or which select among multiple associated multimedia 
objects 1 16 in a hierarchy. 

If the destination client station 1 10 detects any properties to be deter- 
mined, it continues with the next step. Otherwise, it continues with the step 246. 

At a step 245, similar to the step 226, the destination client station 1 10 
determines if it should override values for the properties of the multimedia objects 
1 16. such as if directed to by an operator at the destination client station 1 10. 
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At a step 246. similar to the step 223. the destination client station 110 
examines the properties of any associated ensemble of multimedia objects 116. de- 
termines if there is a theme associated with any such ensemble, and further deter- 
mines if it should override that theme, such as if directed to by an operator at the 
destination client station 1 10. 

At a step 247, the destination client station 1 10 presents the data object 
and its included multimedia objects 1 16. 

At a flow point 250, the data object has been received and presented to 
an operator at one or more destination client stations 1 10. 

Alternative Embodiments 

Although preferred embodiments are disclosed herein, many variations 
are possible which remain within the concept, scope, and spirit of the invention, and 
these variations would become clear to those skilled in the art after perusal of this 
application. 
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9. A method as in claim 6. wherein said editable properties are 
editable in response to a set of editing abbreviations. 



10. A method as in claim 9, wherein each said editing abbreviation 
comprises a relatively short sequence of keystrokes or mouse actions. 

11. A method as in claim 6, including the steps of 
communicating at least one of said editable properties to a recipient 

with said multimedia object; and 

presenting said multimedia object to said recipient in accordance with 
said at least one of said editable properties. 

12. A method as in claim 11, including the step of conditionally 
overriding at least one of said editable properties in response to a capability of said 
recipientOs presentation device, whereby said multimedia object is presented to said 
recipient in accordance with a different at least one of said editable properties. 

13. A method as in claim 11, including the step of conditionally 
overriding at least one of said editable properties in response to an action by said re- 
cipient, whereby said multimedia object is presented to said recipient in accordance 
with a different at least one of said editable properties. 

14. A method as in claim 13, wherein said action includes time 
taken by said recipient to review the multimedia object. 

15. A method as in claim 1, wherein said multimedia objects in- 
clude a text object, a sound object, a picture object, an animation object, or a pro- 
gram fragment. 

16. A method as in claim 15, wherein said program fragments in- 
clude an applet, an application, a pointer to a database retrieval engine, or a URL. 
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Claims 

1 . A method, including the steps of 
associating an abbreviation with a multimedia object; 

5 receiving a set of sequences of keystrokes and mouse actions; 

when said abbreviation is detected in said set of sequences of key- 
strokes and mouse actions, replacing said abbreviation with said multimedia object. 

2. A method as in claim 1, wherein said abbreviation comprises a 
10 relatively short sequence of keystrokes or mouse actions. 

3. A method as in claim 1, wherein said abbreviation comprises a 

typed word. 



15 4. A method as in claim 1, including the step of communicating 

said multimedia object to a recipient as an electronic chat message or an electronic 
mail message. 

5. A method as in claim 1, including the step of presenting said 
20 multimedia object to a recipient in place of said abbreviation. 

6. A method as in claim 1, wherein each said multimedia object 
has a set of editable properties. 

25 7. A method as in claim 6, wherein said editable properties are ef- 

fective to select among a set of alternative multimedia objects, said alternative mul- 
timedia objects differing in the effective editable property. 

8. A method as in claim 6, wherein said editable properties in- 
30 elude a size of said multimedia object, a complexity of said multimedia object, or a 
degree of detail of said multimedia object. 
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17. A method as in claim 1. including the step of associating an en- 
semble with a set of said multimedia objects, said ensemble having a set of ensemble 
properties. 

18. A method as in claim 17, wherein said ensemble properties are 
effective to select among a set of alternative multimedia objects for each multimedia 
object in said set. 

19. A method as in claim 17, wherein said ensemble properties in- 
clude a theme, said theme being effective to select, for each multimedia object in 
said ensemble, one multimedia object from a set of multimedia objects associated 
with said theme. 

20. A method as in claim 17, wherein said ensemble properties are 
editable in response to a set of editing abbreviations. 

21. A method as in claim 20, wherein each said editing abbrevia- 
tion comprises a relatively short sequence of keystrokes or mouse actions. 

22. A method as in claim 17, including the steps of 
communicating at least one of said ensemble properties to a recipient 

with an electronic chat message or an electronic mail message; and 

presenting said multimedia objects to said recipient in accordance with 
said at least one of said ensemble properties. 

23. A method as in claim 22, including the step of conditionally 
overriding at least one of said ensemble properties in response to a capability of said 
recipient's presentation device, whereby said multimedia objects are presented to 
said recipient in accordance with a different at least one of said ensemble properties. 

24. A method as in claim 22, including the step of conditionally 
overriding at least one of said ensemble properties in response to an action by said 
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recipient, whereby said multimedia objects are presented to said recipient in accor- 
dance with a different at least one of said ensemble properties. 

25. A method as in claim 24, wherein said action includes time 
taken by said recipient to review the multimedia objects. 

26. A method as in claim 1, including the steps of 
receiving a set of multimedia objects; and 

when one multimedia object in said set is detected having an associ- 
ated abbreviation, replacing said multimedia object with said abbreviation. 

27. A method as in claim 26, wherein said set of multimedia objects 
are associated with an ensemble. 

28. A method as in claim 26, wherein said set of multimedia objects 
are included in a web page or a web site. 

29. A method as in claim 26, including the step of transmitting a set 
of associations of said abbreviations with said multimedia objects. 

30. A method as in claim 26, including the step of transmitting said 
set of multimedia objects after having inserted said abbreviations and before having 
removed said abbreviations. 

31. A system, including 

a database having a set of abbreviations, each associated with at least 
one corresponding multimedia object: 

an input device for a sequence of keystrokes or mouse actions; 

means for detecting at least one of said abbreviations in said sequence 
and for replacing said abbreviation with said at least one corresponding multimedia 
object. 
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32. A system as in claim 3K wherein each said abbreviation com- 
prises a relatively short sequence of keystrokes or mouse actions. 



33. A system as in claim 31, wherein each said abbreviation com- 
5 prises a typfed word. 

34. A system as in claim 31, including means for communicating 
said multimedia object to a recipient as an electronic chat message or an electronic 
mail message. 

10 

35. A system as in claim 31, including means for presenting said 
multimedia object to a recipient in place of said abbreviation. 

36. A system as in claim 31, wherein each said multimedia object 
15 has a set of editable properties. 

37. A system as in claim 36, wherein said editable properties are 
effective to select among a set of alternative multimedia objects, said alternative 
multimedia objects differing in the effective editable property. 

20 

38. A system as in claim 36, wherein said editable properties in- 
clude a size of said multimedia object, a complexity of said multimedia object, or a 
degree of detail of said multimedia object. 

25 39. A system as in claim 36, wherein said editable properties are 

editable in response to a set of editing abbreviations. 

40. A system as in claim 39, wherein each said editing abbreviation 
comprises a relatively short sequence of keystrokes or mouse actions. 

30 

41 . A system as in claim 36, including 
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means for communicating at least one of said editable properties to a 
recipient with said multimedia object; and 

means for presenting said multimedia object to said recipient in accor- 
dance with said at least one of said editable properties. 

42. A system as in claim 41, including means for conditionally 
overriding at least one of said editable properties in response to a capability of said 
recipientOs presentation device, whereby said multimedia object is presented to said 
recipient in accordance with a different at least one of said editable properties. 

43. A system as in claim 41, including means for conditionally 
overriding at least one of said editable properties in response to an action by said re- 
cipient, whereby said multimedia object is presented to said recipient in accordance 
with a different at least one of said editable properties. 

44. A system as in claim 43, wherein said action includes time 
taken by said recipient to review the multimedia object. 

45. A system as in claim 31, wherein said multimedia objects in- 
clude a text object, a sound object, a picture object, an animation object, or a pro- 
gram fragment. 

46. A system as in claim 45, wherein said program fragments in- 
clude an applet, an application, a pointer to a database retrieval engine, or a URL. 

47. A system as in claim 3 1 , including means for associating an en- 
semble with a set of said multimedia objects, said ensemble having a set of ensemble 
properties. 

48. A system as in claim 47, wherein said ensemble properties are 
effective to select among a set of alternative multimedia objects for each multimedia 
object in said set. 

24 

SUBSTITUTE SHEET (RULE 26) 



}VO 99/50744 



PCT/US99/07257 



49. A system as in claim 47. wherein said ensemble properties in- 
clude a theme ? said theme being effective to select, for each multimedia object in 
said ensemble, one multimedia object from a set of multimedia objects associated 
with said theme. 

50. A system as in claim 47 ? wherein said ensemble properties are 
editable in response to a set of editing abbreviations. 

51. A system as in claim 50, wherein each said editing abbreviation 
comprises a relatively short sequence of keystrokes or mouse actions. 

52. A system as in claim 47, including 

means for communicating at least one of said ensemble properties to a 
recipient with an electronic chat message or an electronic mail message; and 

means for presenting said multimedia objects to said recipient in ac- 
cordance with said at least one of said ensemble properties. 

53. A system as in claim 52, including means for conditionally 
overriding at least one of said ensemble properties in response to a capability of said 
recipientOs presentation device, whereby said multimedia objects are presented to 
said recipient in accordance with a different at least one of said ensemble properties. 

54. A system as in claim 52, including means for conditionally 
overriding at least one of said ensemble properties in response to an action by said 
recipient, whereby said multimedia objects are presented to said recipient in accor- 
dance with a different at least one of said ensemble properties. 

55. A system as in claim 54, wherein said action includes time 
taken by said recipient to review the multimedia objects. 

56. A system as in claim 3 1 . including 
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means for receiving a set of multimedia objects; and 
means for detecting when one multimedia object in said set has an as- 
sociated abbreviation, for replacing said multimedia object with said abbreviation, 

57. A system as in claim 56, wherein said set of multimedia objects 
are associated with an ensemble. 

58. A system as in claim 56, wherein said set of multimedia objects 
are included in a web page or a web site. 

59. A system as in claim 56, including means for transmitting a set 
of associations of said abbreviations with said multimedia object^. 

60. A system as in claim 56, including means for transmitting said 
set of multimedia objects after having inserted said abbreviations and before having 
removed said abbreviations. 
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